This document presents the Bonn PRINTEGER Consensus Statement: Working with Research Integrity—Guidance for research performing organisations. The aim of the statement is to complement existing instruments by focusing specifically on institutional responsibilities for strengthening integrity. It takes into account the daily challenges and organisational contexts of most researchers. The statement intends to make research integrity challenges recognisable from the work-floor perspective, providing concrete advice on organisational measures to strengthen integrity. The statement, which was concluded February 7th 2018, provides guidance on (...) the following key issues: § 1.Providing information about research integrity § 2.Providing education, training and mentoring § 3.Strengthening a research integrity culture § 4.Facilitating open dialogue § 5.Wise incentive management § 6.Implementing quality assurance procedures § 7.Improving the work environment and work satisfaction § 8.Increasing transparency of misconduct cases § 9.Opening up research § 10.Implementing safe and effective whistle-blowing channels § 11.Protecting the alleged perpetrators § 12.Establishing a research integrity committee and appointing an ombudsperson § 13.Making explicit the applicable standards for research integrity. (shrink)

How are “interesting” research problems identified and made durable by academic researchers, particularly in situations defined by multiple evaluation principles? Building on two case studies of research groups working on rare diseases in academic biomedicine, we explore how group leaders arrange their groups to encompass research problems that latch onto distinct evaluation principles by dividing and combining work into “basic-oriented” and “clinical-oriented” spheres of inquiry. Following recent developments in the sociology of valuation comparing academics to capitalist entrepreneurs in pursuit of (...) varying kinds of worth, we argue that the metaphor of the portfolio is helpful in analyzing how group leaders manage these different research lines as “alternative investment options” from which they were variously hoping to capitalize. We argue portfolio development is a useful concept for exploring how group leaders fashion “entrepreneurial” practices to manage and exploit tensions between multiple matrices of valuation and conclude with suggestions for how this vocabulary can further extend analysis of epistemic capitalism within science and technology studies. (shrink)

The range and types of performance metrics has recently proliferated in academic settings, with bibliometric indicators being particularly visible examples. One field that has traditionally been hospitable towards such indicators is biomedicine. Here the relative merits of bibliometrics are widely discussed, with debates often portraying them as heroes or villains. Despite a plethora of controversies, one of the most widely used indicators in this field is said to be the Journal Impact Factor. In this article we argue that much of (...) the current debates around researchers’ uses of the JIF in biomedicine can be classed as ‘folk theories’: explanatory accounts told among a community that seldom get systematically checked. Such accounts rarely disclose how knowledge production itself becomes more-or-less consolidated around the JIF. Using ethnographic materials from different research sites in Dutch University Medical Centers, this article sheds new empirical and theoretical light on how performance metrics variously shape biomedical research on the ‘shop floor.’ Our detailed analysis underscores a need for further research into the constitutive effects of evaluative metrics. (shrink)

Over the past decades, science funding shows a shift from recurrent block funding towards project funding mechanisms. However, our knowledge of how project funding arrangements influence the organizational and epistemic properties of research is limited. To study this relation, a bridge between science policy studies and science studies is necessary. Recent studies have analyzed the relation between the affordances and constraints of project grants and the epistemic properties of research. However, the potentially very different affordances and constraints of funding arrangements (...) such as awards, prizes and fellowships, have not yet been taken into account. Drawing on eight case studies of funding arrangements in high performing Dutch research groups, this study compares the institutional affordances and constraints of prizes with those of project grants and their effects on organizational and epistemic properties of research. We argue that the prize case studies diverge from project-funded research in three ways: 1) a more flexible use, and adaptation of use, of funds during the research process compared to project grants; 2) investments in the larger organization which have effects beyond the research project itself; and 3), closely related, greater deviation from epistemic and organizational standards. The increasing dominance of project funding arrangements in Western science systems is therefore argued to be problematic in light of epistemic and organizational innovation. Funding arrangements that offer funding without scholars having to submit a project-proposal remain crucial to support researchers and research groups to deviate from epistemic and organizational standards. (shrink)

Research integrity is usually discussed in terms of responsibilities that individual researchers bear towards the scientific work they conduct, as well as responsibilities that institutions have to enable those individual researchers to do so. In addition to these two bearers of responsibility, a third category often surfaces, which is variably referred to as culture and practice. These notions merit further development beyond a residual category that is to contain everything that is not covered by attributions to individuals and institutions. This (...) paper discusses how thinking in RI can take benefit from more specific ideas on practice and culture. We start by articulating elements of practice and culture, and explore how values central to RI are related to these elements. These insights help identify additional points of intervention for fostering responsible conduct. This helps to build “cultures and practices of research integrity”, as it makes clear that specific times and places are connected to specific practices and cultures and should have a place in the debate on Research Integrity. With this conceptual framework, practitioners as well as theorists can avoid using the notions as residual categories that de facto amount to vague, additional burdens of responsibility for the individual. (shrink)

This paper aims to explore disciplinary variation in valuation practices by comparing the way research groups accumulate credibility across four epistemic cultures. Our analysis is based on case studies of four high-performing research groups representing very different epistemic cultures in humanities, social sciences, geosciences and mathematics. In each case we interviewed about ten researchers, analyzed relevant documents and observed a couple of meetings. In all four cases we found a cyclical process of accumulating credibility. At the same time, we found (...) significant differences in the manifestation of the six main resources that are part of the cycle, the mechanisms of conversion between these resources, the overall structure and the average speed of the credibility cycle. The different ways in which the groups use data and produce arguments affect the whole cycle of accumulating credibility. In some cultures, journal publications are the main source of recognition, but in others one can earn significant amounts of recognition for conference contributions or service to the academic community. Moreover, the collaboration practices in the respective fields strongly influence the connection between arguments and publications. In cultures where teams of researchers collaboratively produce arguments, it is more strongly embedded in the process of writing publications. We conclude that the credibility cycle can only be used as an analytical tool to explain the behavior of researchers or research groups when taking differences across epistemic cultures into account. (shrink)

BackgroundResearch codes of conduct offer guidance to researchers with respect to which values should be realized in research practices, how these values are to be realized, and what the respective responsibilities of the individual and the institution are in this. However, the question ofhowthe responsibilities are to be divided between the individual and the institution has hitherto received little attention. We therefore performed an analysis of research codes of conduct to investigate how responsibilities are positioned as individual or institutional, and (...) how the boundary between the two is drawn.MethodWe selected 12 institutional, national and international codes of conduct that apply to medical research in the Netherlands and subjected them to a close-reading content analysis. We first identified the dominant themes and then investigated how responsibility is attributed to individuals and institutions.ResultsWe observed that the attribution of responsibility to either the individual or the institution is often not entirely clear, and that the notion ofcultureemerges as a residual category for such attributions. We see this notion of responsible research cultures as important; it is something that mediates between the individual level and the institutional level. However, at the same time it largely lacks substantiation.ConclusionsWhile many attributions of individual and institutional responsibility are clear, the exact boundary between the two is often problematic. We suggest two possible avenues for improving codes of conduct: either to clearly attribute responsibilities to individuals or institutions and depend less on the notion of culture, or to make culture a more explicit concern and articulate what it is and how a good culture might be fostered. (shrink)

Global university rankings have become increasingly important ‘calculative devices’ for assessing the ‘quality’ of higher education and research. Their ability to make characteristics of universities ‘calculable’ is here exemplified by the first proper university ranking ever, produced as early as 1910 by the American psychologist James McKeen Cattell. Our paper links the epistemological rationales behind the construction of this ranking to the sociopolitical context in which Cattell operated: an era in which psychology became institutionalized against the backdrop of the eugenics (...) movement, and in which statistics of science became used to counter a perceived decline in ‘great men.’ Over time, however, the ‘eminent man,’ shaped foremost by heredity and upbringing, came to be replaced by the excellent university as the emblematic symbol of scientific and intellectual strength. We also show that Cattell’s ranking was generative of new forms of the social, traces of which can still be found today in the enactment of ‘excellence’ in global university rankings. (shrink)

Illustrations played an important role in the articulation of Wundt’s experimental program. Focusing on the woodcuts of apparatus and experimental designs in the six editions of his Grundzüge der physiologischen Psychologie (published between 1873 and 1911), we investigate the uses and functions of illustrations in the experimental culture of the physiological and psychological sciences. We will first present some statistics on the increasing number of illustrations Wundt included in each new edition of his handbook. Next we will show how Wundt (...) managed to introduce the material and literary technologies of physiology into the ‘new psychology’. The distribution of Wundt’s material technology will be further demonstrated by highlighting the crucial role of technicians and instrument-makers. We will use Shapin and Schaffer’s notions of the ‘three technologies’ and ‘virtual witnessing’, combined with Latour’s concept of ‘immutable mobiles’, as analytical tools to explore the strategic aspects of Wundt’s illustrations. (shrink)